An Investigation of Explanation Multiple-Choice Items in Science Assessment     

Ou Lydia Liu  Hee-Sun Lee  Marcia C. Linn 《Educational Assessment》2013,18(3):164-184

Both multiple-choice and constructed-response items have known advantages and disadvantages in measuring scientific inquiry. In this article we explore the function of explanation multiple-choice (EMC) items and examine how EMC items differ from traditional multiple-choice and constructed-response items in measuring scientific reasoning. A group of 794 middle school students was randomly assigned to answer either constructed-response or EMC items following regular multiple-choice items. By applying a Rasch partial-credit analysis, we found that there is a consistent alignment between the EMC and multiple-choice items. Also, the EMC items are easier than the constructed-response items but are harder than most of the multiple-choice items. We discuss the potential value of the EMC items as a learning and diagnostic tool.  相似文献   

Assessing Knowledge Integration in Science: Construct,Measures, and Evidence     

Ou Lydia Liu  Hee-Sun Lee  Carolyn Hofstetter  Marcia C. Linn 《Educational Assessment》2013,18(1):33-55

In response to the demand for sound science assessments, this article presents the development of a latent construct called knowledge integration as an effective measure of science inquiry. Knowledge integration assessments ask students to link, distinguish, evaluate, and organize their ideas about complex scientific topics. The article focuses on assessment topics commonly taught in 6th- through 12th-grade classes. Items from both published standardized tests and previous knowledge integration research were examined in 6 subject-area tests. Results from Rasch partial credit analyses revealed that the tests exhibited satisfactory psychometric properties with respect to internal consistency, item fit, weighted likelihood estimates, discrimination, and differential item functioning. Compared with items coded using dichotomous scoring rubrics, those coded with the knowledge integration rubrics yielded significantly higher discrimination indexes. The knowledge integration assessment tasks, analyzed using knowledge integration scoring rubrics, demonstrate strong promise as effective measures of complex science reasoning in varied science domains.  相似文献   

Conceptualising and measuring student engagement through the Australasian Survey of Student Engagement (AUSSE): a critique     

Pauline Hagel  Rodney Carr  Marcia Devlin 《Assessment & Evaluation in Higher Education》2012,37(4):475-486

Student engagement has rapidly developed a central place in the quality agenda of Australian universities since the introduction of the Australasian Survey of Student Engagement (AUSSE). The AUSSE is based on one developed in the USA. The main arguments given for adopting this survey in Australia are that it provides a valid instrument for measuring engagement and that it enables international comparisons. However, the survey instrument and scales have been adopted with little scrutiny of these arguments. This paper examines these arguments by considering different perspectives of engagement, examining the importance of contextual differences and evaluating the AUSSE engagement scales in the light of both. The paper concludes that the AUSSE results should be used by universities and policy‐makers with caution.  相似文献   

Managerial coaching: A review of the literature     

Marcia S. Hagen 《Performance Improvement Quarterly》2012,24(4):17-39

Managerial coaching has become increasingly popular despite limited empirical evidence of its impact on the individuals giving and receiving coaching, and its impact on the workplace overall. This article reviews the literature on the definition of practice of managerial coaching, and what managerial coaching looks like in terms of skills and behaviors, and examines the empirical evidence that currently exists. Models representing new current research and gaps within the literature are advanced, and future research implications are explored.  相似文献   

Validating Measurement of Knowledge Integration in Science Using Multiple-Choice and Explanation Items     

Hee-Sun Lee  Ou Lydia Liu  Marcia C. Linn 《教育实用测度》2013,26(2):115-136

This study explores measurement of a construct called knowledge integration in science using multiple-choice and explanation items. We use construct and instructional validity evidence to examine the role multiple-choice and explanation items plays in measuring students' knowledge integration ability. For construct validity, we analyze item properties such as alignment, discrimination, and target range on the knowledge integration scale using a Rasch Partial Credit Model analysis. For instructional validity, we test the sensitivity of multiple-choice and explanation items to knowledge integration instruction using a cohort comparison design. Results show that (1) one third of correct multiple-choice responses are aligned with higher levels of knowledge integration while three quarters of incorrect multiple-choice responses are aligned with lower levels of knowledge integration, (2) explanation items discriminate between high and low knowledge integration ability students much more effectively than multiple-choice items, (3) explanation items measure a wider range of knowledge integration levels than multiple-choice items, and (4) explanation items are more sensitive to knowledge integration instruction than multiple-choice items.  相似文献   

Diversity among Spanish-speaking English language learners: profiles of early literacy skills in kindergarten     

Karen L. Ford  Sonia Q. Cabell  Timothy R. Konold  Marcia Invernizzi  Lauren B. Gartland 《Reading and writing》2013,26(6):889-912

This study explored heterogeneity in literacy development among 2,300 Hispanic children receiving English as a Second Language (ESL) services at the start of kindergarten. Two research questions guided this work: (1) Do Spanish-speaking English language learners receiving ESL services in the fall of kindergarten demonstrate homogeneous early literacy skills, or are there distinct patterns of achievement across measures of phonological awareness, alphabet knowledge, and orthography? and (2) if there are distinct profiles, to what extent do they predict literacy achievement at the end of kindergarten and the beginning of first grade? Using cluster analysis, the authors identified four distinct literacy profiles derived from fall kindergarten measures of phonological awareness, alphabet knowledge, and phonetic spelling. These profiles were found to be associated with literacy outcomes in spring of kindergarten and fall of first grade. The two profiles that were associated with greater success on later measures of concept of word in text, letter sound knowledge, word reading, and spelling were the two that included stronger performance on orthographic skills (i.e., alphabet knowledge and phonetic spelling). These findings demonstrated that there is heterogeneity among Hispanic ESL students at kindergarten entry and suggested that literacy instruction must be differentiated from the very beginning in order to meet students’ individual needs. The findings also suggested that orthographic skills should be assessed and taught early on. While phonological awareness may be a necessary precursor to reading, phonological awareness in the absence of orthographic skills may not be sufficient.  相似文献   

A Technology‐Enhanced Unit of Modeling Static Electricity: Integrating scientific explanations and everyday observations     

Ji Shen  Marcia C. Linn 《International Journal of Science Education》2013,35(12):1597-1623

What trajectories do students follow as they connect their observations of electrostatic phenomena to atomic‐level visualizations? We designed an electrostatics unit, using the knowledge integration framework to help students link observations and scientific ideas. We analyze how learners integrate ideas about charges, charged particles, energy, and observable events. We compare learning enactments in a typical school and a magnet school in the USA. We use pre‐tests, post‐tests, embedded notes, and delayed post‐tests to capture the trajectories of students’ knowledge integration. We analyze how visualizations help students grapple with abstract electrostatics concepts such as induction. We find that overall students gain more sophisticated ideas. They can interpret dynamic, interactive visualizations, and connect charge‐ and particle‐based explanations to interpret observable events. Students continue to have difficulty in applying the energy‐based explanation.  相似文献   

AI新时代面向文化遗产活化利用的智慧数据生成路径探析     

范炜  曾蕾 《中国图书馆学报》2024,50(2):4-29

生成式人工智能引爆AI新时代,新技术不断涌现并快速迭代更新,AI技术应用呈现出百花齐放、百家争鸣的繁荣发展局面。借助AI发展东风,智慧数据的生成进入了高效、深化、多模态集成的新阶段,提升了数据驱动的文化遗产活化利用创新手段和创新形式的丰富度与可行性。本文旨在探索面向文化遗产活化利用的智慧数据生成路径。首先,从AI技术视角,对文化遗产智慧数据的内涵与价值进行回顾并知新;其次,系统分析从多元异构数据资源中生成智慧数据的典型做法;再次,以羌年为例,探讨非遗活态文化的智慧数据生成思路。最后,总结归纳AI赋能文化遗产智慧数据生成路径的四点参考策略：(1)抓住AI赋能机遇,补齐数据基础设施短板,加强数据资源体系建设;(2)尽快开展馆藏数据资源的“大语言模型+知识库”结合工作,实现智能分析与计算增强;(3)鼓励更广泛的文化遗产数据开放与共享,支持活化利用的创新应用;(4)确保可信的智慧数据。图3。表1。参考文献68。  相似文献   

Viewing Michigan’s digital future: results of a survey of educators’ use of digital video in the USA   总被引：1，自引：1，他引：0  

Marcia A. Mardis 《Learning, Media and Technology》2009,34(3):243-257

Digital video is a growing and important presence in student learning. This paper reports the results of a survey of American educators in Michigan (n = 426) conducted in spring 2008. The survey included questions about educators’ attitudes toward the streaming and downloadable video services available to them in their schools. The survey results showed that educators mainly used digital video to introduce and to conclude learning experiences. These educators, who predominantly used the Web‐based unitedstreaming ^TM digital video service, relished the service’s content breadth, short clips and potential to foster instructional innovation. However, many survey respondents reported concerns about internet connection bandwidth, projection capabilities and lack of end‐user control over on‐demand download and manipulation. Educators viewed school‐level Information and Communications Technology policies, bandwidth capacity and lack of support personnel as the causes of these difficulties. Because little research has been done on the implementation of digital video services in US schools, the conclusions of this study may provide direction for educators, researchers and policy‐makers who use a variety of digital video platforms and services.  相似文献   

Wild botanic gardens as valuable resources for innovative environmental education programmes in Latin America     

Rafael Suárez-López  Marcia Eugenio 《Environmental Education Research》2018,24(8):1102-1114

Wild botanic gardens consist of natural or semi-natural land remnants immersed in large urban areas or botanic gardens, which are managed for purposes of biodiversity preservation and public recreation. In Latin America, they tend to be affected by budget limitations; however, they serve as valuable resources that permit the development of innovative environmental education programmes. Specifically, we are considering the appropriateness of implementing critical environmental education and socio-constructivist programmes. As for practical considerations, it is important to include diverse epistemologies, and therefore, strategies or procedures characteristic of science teaching, such as problem-based learning, together with other characteristics of social activism and popular education initiatives, such as assemblies or meetings, and others characteristic of more traditional and indigenous worldviews, such as celebrations of the earth. In this way, Latin American wild botanic gardens may play a role in constructing environmentally responsible societies and the nurturing of a culture of reflective inquiry.  相似文献